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Abstract. Incremental stability is a property of dynamical and control systems, requiring the uniform as- 
ymptotic stability of every trajectory, rather than that of an equilibrium point or a particular time-varying 
trajectory. Similarly to stability, Lyapunov functions and contraction metrics play important roles in the study 
of incremental stability. In this paper, we provide characterizations and descriptions of incremental stability 
in terms of existence of coordinate-invariant notions of incremental Lyapunov functions and contraction met- 
rics, respectively. Most design techniques providing controllers rendering control systems incrementally stable 
have two main drawbacks: they can only be applied to control systems in either parametric-strict-feedback 
or strict-feedback form, and they require these control systems to be smooth. In this paper, we propose a 
design technique that is applicable to larger classes of (not necessarily smooth) control systems. Moreover, 
we propose a recursive way of constructing contraction metrics (for smooth control systems) and incremental 
Lyapunov functions which have been identified as a key tool enabling the construction of finite abstractions 
of nonlinear control systems, the approximation of stochastic hybrid systems, source-code model checking for 
nonlinear dynamical systems and so on. The effectiveness of the proposed results in this paper is illustrated by 
synthesizing a controller rendering a non-smooth control system incrementally stable as well as constructing 
its finite abstraction, using the computed incremental Lyapunov function. 



1. Introduction 

Incremental stability is a stronger property than stability for dynamical and control systems. In incremental 
stability, focus is on convergence of trajectories with respect to each other rather than with respect to an 
equilibrium point or a specific trajectory. Similarly to stability, Lyapunov functions play an important role in 
the study of incremental stability. In Ang02 , Angeli proposed the notions of incremental Lyapunov function 
and incremental input-to-state Lyapunov function, and used these notions to provide characterizations of 
incremental global asymptotic stability (5-GAS) and incremental input-to-state stability (<5-ISS). Notions of 
(5-GAS, (5-ISS and incremental Lyapunov functions, proposed in |Ang02| , are not coordinate invariant, in 
general. Since most of the controller design approaches benefit from changes of coordinates, in [ZTllj . the 
authors proposed different notions of 5-GAS and (5-ISS which are coordinate invariant. In [ZM11| , the authors 
proposed notions of incremental Lyapunov function and incremental input-to-state Lyapunov function that 
are coordinate invariant as well. We use these new notions of Lyapunov functions to fully characterize the 
notions of incremental (input-to-state) stability as proposed in |ZTllj . Furthermore, we provide sufficient 
conditions for coordinate invariant incremental (input-to-state) stability in the form of contraction metrics 
inspired by the work in [AR03J. 

The number of applications of incremental stability has increased progressively in the past years. Examples 
include building explicit bounds on the region of attraction in phase-locking in the Kuramoto system (FCPL10] , 
modeling of nonlinear analog circuits |BML + 10 , robustness analysis of systems over finite alphabets |TMD08| , 



global synchronization in networks of cyclic feedback systems |HSSG12j , control reconfiguration of piecewise 
affine systems with actuator and sensor faults [RHvdWLllj . construction of symbolic models for nonlinear 
control systems [PGT08| IGPT091 IPT09j . and synchronization |RdB091 ISS07] . Unfortunately, there are very 
few results available in the literature regarding the design of controllers enforcing incremental stability of the 
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resulting closed-loop systems. Therefore, there is a growing need to develop design methods rendering control 
systems incrementally stable. 

Related works include controller designs for convergence of Lur'e-type systems |PvdWN05l [PvdWN07] and 
a class of piecewise affine systems vdWP08 through the solution of linear matrix inequalities (LMIs). In 
contrast, the current paper does not require the solution of LMIs and the existence of controllers is always 
guaranteed for the class of systems under consideration. The quest for backstepping design approaches for 
incremental stability has received increasing attention recently. Recently obtained results include backstepping 
design approaches rendering parametric-strict-feedbacl^] form systems incrementally globally asymptotically 
stable]^] using the notion of contraction metrics in [JL02 , SK09 , SK08 , and backstepping design approaches 
rendering strict-feedback 1 form systems incrementally input-to-state stabk^] using the notion of contraction 
metrics and incremental Lyapunov functions in [ZTllj . and |ZM11| . respectively. The results in |PvdWN05] 
offer a backstepping design approach rendering a larger class of control systems than those in strict-feedback 
form input-to-state convergent, rather than incrementally input-to-state stable. We will build upon these 
results in PvdWN05 and extend those in the scope of incremental stability. The notion of (input-to-state) 
convergence requires existence of a trajectory which is bounded on the whole time axis which is not required in 
the case of incremental input-to-state stability. The notion of input-to-state convergence can not be applied to 
the results in [PGT08, GPT09, PT09 , which require the uniform global asymptotic stability of every trajectory 
rather than that of a particular trajectory that is bounded on the entire time axis. See [ZTlll |PPvdWN04] 
for a brief comparison between the notions of convergent system and incremental stability. 

Our techniques improve upon most of the existing backstepping techniques in three directions: 

1) by providing controllers enforcing not only incremental global asymptotic stability but also incremental 
input-to-state stability; 

2) by being applicable to larger classes of (non-smooth) control systems; 

3) by providing a recursive way of constructing not only contraction metrics but also incremental Lya- 
punov functions. 

In the first direction, our technique extends the results in [JL02| SK09, SK08 , where only controllers enforcing 
incremental global asymptotic stability are designed. In the second direction, our technique improves the 
results in [JL02, SK09, SK08 , which are only applicable to smooth parametric-strict-feedback form systems, 
and the results in |ZT11[ IZM11] . which are only applicable to smooth strict-feedback form systems. In 
the third direction, our technique extends the results in |JL02[ ISK091 ISK081 IZT11] , where the authors only 
provide a recursive way of constructing contraction metrics, and the results in [PvdWN05 , where the authors 
do not provide a way to construct Lyapunov functions characterizing the input-to-state convergence property 
induced by the controller. Note that the explicit availability of incremental Lyapunov functions is necessary 
in many applications. Examples include the construction of symbolic models for nonlinear control systems 
[GPT091 IGirl21 ICGGllj , robust test generation of hybrid systems jJFA + 07) , the approxima tion of sto chastic 
hybrid systems |JP09| . and source-code model checking for nonlinear dynamical systems [KDL + 08] , Note 
that incremental Lyapunov functions can be used as bisimulation functions, recognized as a key tool for the 
analysis in jJFA+07l IJFA+071 IKDL+08] . 

Our technical results are illustrated by designing an incrementally input-to-state stabilizing controller for an 
unstable non-smooth control system that does not satisfy the assumptions required in |JL02[ [SK09 , SK08 , 
IZT11[ IZMllj . Moreover, we construct a finite bisimilar abstraction for the resulting incrementally stable 
closed-loop system using the results in |GPT09| . which, however, apply only to incrementally stable systems 
with explicitly available incremental Lyapunov functions. When a finite abstraction is available, the synthesis 
of the controllers satisfying logic specifications expressed in linear temporal logic or automata on infinite 
strings can be easily reduced to a fixed-point computation over the finite-state abstraction [Tab09j . Note that 

1 See |KKK95| for a definition. 
2 Understood in the sense of Definition 2.2 
■^Understood in the sense of Definition 2.3 
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satisfying those specifications is difficult or impossible to enforce with conventional control design methods. 
We synthesize another controller on top of the resulting incrementally stable closed-loop system satisfying 
some logic specification explained in details in the example section. 

The outline of the paper is as follows. Section 2 provides some mathematical preliminaries, the definition of 
the class of control systems that we consider in this paper, and stability notions. Section 3 provides charac- 
terizations of incremental stability in terms of existence of incremental Lyapunov functions and contraction 
metrics. In Section 4, we present the proposed backstepping design approach. An illustrative (non-smooth) 
example is discussed in details in Section 5. Finally, Section 6 concludes the paper. 



2. Control Systems and Stability Notions 

2.f . Notation. The symbols Z, N, N , R, R + and Rq" denote the set of integer, positive integer, nonnegative 
integer, real, positive, and nonnegative real numbers, respectively. The symbols I m , mX n, and m denote 
the identity and zero matrices in ffi mxm and R mx ™, and the zero vector in R m , respectively. Given a vector 
x £ R™, we denote by Xi the i-th element of a;, by \xi \ the absolute value of Xi, and by \\x\\ the Euclidean norm 
of x; we recall that ||x|| — \/ x\ + x\ + ... + x^ for x £ R n . Given a measurable function / : M.q — > R", the 
(essential) supremum of / is denoted by ||/||oo; we recall that ||/||oo := (css)sup{||/(£)||,< > 0} and ||/||[o, r ) : = 
(ess)sup{||/(i)||, t £ [0,t)}. A function / is essentially bounded if ||/||oo < oo. For a given time r £ R + , define 
f T so that f T if) = f(i), for any t £ [0, r), and f T (t) = elsewhere; / is said to be locally essentially bounded if 
for any r £ R + , f T is essentially bounded. A function / : R n — > Rj is called radially unbounded if f(x) — > oo 
as ||x|| — > oo. The closed ball centered at x £ R m with radius e is defined by B e (x) = {y £ R m | \\x — y\\ < e}. 
A continuous function 7 : Rq" — > Rq , is said to belong to class K, if it is strictly increasing and 7(0) = 0; 7 
is said to belong to class /Coo if 7 G /C and j(r) —> 00 as r — > 00. A continuous function j3 : Rq x R^ — > R^ 
is said to belong to class ICC if, for each fixed s, the map /3(r, s) belongs to class JC^ with respect to r 
and, for each fixed nonzero r, the map /3(r, s) is decreasing with respect to s and /3(r, s) — > as s — > 00. If 
(j> : R™ -> R" is a global diffeomorphism and G : R" -> R" x ™ is a smooth map, the notation (f>*G : R" -> R" x ™ 
denotes the smooth map {4>*G)(x) = (§|) T G(0(x))(||). A Riemannian metric G : R n — » R nxn is a smooth 
map on R" such that, for any x £ R n , G(x) is a symmetric positive definite matrix |Lee03] . For any x £ R™ 
and smooth functions /, J : R™ ^ R™, one can define the scalar function (I,J)q as I T (x)G(x) J(x). We 
will still use the notation (I,J)q to denote I T GJ even if G does not represent a Riemannian metric. A 
function d : R™ x R" — > R^ is a metric on R™ if for any x,y 7 z £ R™, the following three conditions are 
satisfied: i) d(x,y) = if and only if x = y; ii) d(x, y) = d(y, x); and iii) d(x,z) < d(x,y) + d(y,z). We 
use the pair (R",d) to denote a metric space R n equipped with the metric d. We use the notation d^ to 
denote the Riemannian distance function provided by the Riemannian metric G, as defined for example in 



|Lee03j . We refer to the proof of Lemma 3.12 in the paper for the definition of d^. For a set A C R n , 
a metric d, and any x £ R™, we abuse the notation by using d(x,A) to denote the point-to-set distance, 
defined by d(x,A) — inf aS _4 d(x, y). A function / is said to be smooth if it is an infinitely differentiable 
function of its arguments. Given measurable functions / : Rq" — > R ra and g : Rj — > R™, we define d(f,g) oa := 
(ess)sup{d(/(*), <?(*)), t>0} andd(/ > 5)[o,T) := (ess)sup{d(f(t),g(t)),t £ [0,r)}. 

2.2. Control Systems. The class of control systems that we consider in this paper is formalized in the 
following definition. 

Definition 2.1. A control system is a quadruple: 

S = (R",U,W,/), 

where: 

• R™ is the state space; 

• U C R m is the input set; 
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• hi is the set of all measurable, locally essentially bounded functions of time from intervals of the form 
]a, b[C R to U with a < and b > 0; 

• / : M" x U — > WL n is a continuous map satisfying the following Lipschitz assumption: for every compact 
set Q C M n , there exists a constant Z G R + such that \\f(x,u) — f{y,u)\\ < Z\\x — y\\ for all x,y G Q 
and all u G U. 

A curve £ :]a, b[— > K™ is said to be a trajectory of E if there exists v G U satisfying: 

i(t) = f(at),v(t)), 

for almost all t G ]a, b[. Although we have defined trajectories over open domains, we shall refer to trajectories 
£ :[0,t] — > K n defined on closed domains [0, i], t G M + with the understanding of the existence of a trajectory 
£' :}a,b[— > K n such that £ = C'l[o,t] with a < and b > t. We also write £, X v(t) to denote the point reached at 
time t under the input v from initial condition x = t; xv (0)', the point £ X v{t) 1S uniquely determined, since the 
assumptions on / ensure existence and uniqueness of trajectories |Son98j . 

A control system E is said to be forward complete if every trajectory is defined on an interval of the form 
]a, oo [. Sufficient and necessary conditions for a system to be forward complete can be found in [AS99]. A 
control system E is said to be smooth if / is smooth. 

2.3. Stability notions. Here, we recall the notions of incremental global asymptotic stability (<5g-GAS) and 
incremental input-to-state stability (J3-ISS), presented in |ZTllj . 

Definition 2.2 f jZTllj ). A control system E = (M. n ,0,U, f) is incrementally globally asymptotically stable 
(6^-GAS) if it is forward complete and there exist a metric d and a ICC function f3 such that for any t G 
any x,x' G K n and any the following condition is satisfied: 

(2.1) d < $ (d (x, x 1 ) , t) . 



1+ 



As defined in |Ang02[ , 5-GAS requires the metric d to be the Euclidean metric. However, Definition 2.2 only 
requires the existence of a metric. We note that while <5-GAS is not generally invariant under changes of 
coordinates, J^-GAS is. When the origin is an equilibrium point for E, with v(t) = for all t G Kq", and the 
map -0 : M n — > Rj , defined by ip(-) — d(-, 0), is continuous^] and radially unbounded, both <!>3-GAS and (5-GAS 
imply global asymptotic stability. 

Definition 2.3 ( jZTllj ). A control system E = (R n , \J,l4,f) is incrementally input-to- state stable (5^-ISS) 
if it is forward complete and there exist a metric d, a ICC function (3, and a JCqo function 7 such that for any 
t G Rq~, any x, x' G M™ , and any v, v' G U the following condition is satisfied: 

(2-2) d (Uv(t), (t)) </3(d (x, x 1 ) , t) + 7 (||u - t/||J • 



By observing (2.1) and (2.2), it is readily seen that ^-ISS implies (S3-GAS while the converse is not true in 
general. Moreover, whenever the metric d is the Euclidean metric, <5a-ISS becomes 5-lSS as defined in |Ang02| . 
We note that while <5-ISS is not generally invariant under changes of coordinates, J^-ISS is. When the origin is 
an equilibrium point for E, with v(t) — for all t G Rq~, and the map ip:R n -> R+, defined by tp(-) = d(-, 0), 
is continuous 4 and radially unbounded, both J3-ISS and <5-ISS imply input-to-state stability SW95 . 

3. Characterizations of Incremental Stability 

This section contains characterizations and descriptions of <5a-GAS and J^-ISS in terms of existence of in- 
cremental Lyapunov functions and contraction metrics, respectively. We note that only the sufficiency part 
of Lyapunov characterizations of <5g-GAS and <5gTSS were presented in |ZMllj . In Section |4j we will use 
such incremental Lyapunov functions and contraction metrics to synthesize controllers rendering closed-loop 
systems incrementally stable. 



Here, continuity is understood with respect to the Euclidean metric. 
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3.1. Incremental Lyapunov function characterizations. We start by recalling the notions of an incre- 
mental global asymptotic stability (<5g-GAS) Lyapunov function and an incremental input-to-state stability 
((>a-ISS) Lyapunov function, presented in [ZMllj . 

Definition 3.1 ( |ZM11| ). Consider a control system E = (R n , U,U, f) and a smooth function V : R™ x R" -s- R, 

Function V is called a S^-GAS Lyapunov function for E, if there exist a metric d, /C^ functions a, a, and 
K G R + such that: 

(i) for any x, x' G R n , 

a(d(x,a/)) < V(ar,a/) < a(d(x, x')); 

(ii) /or any x, x' G R" and any ueU, 
f^/(a;,n) + f;/(x',n) <- K y(x,x'). 

Function V is called a S^-ISS Lyapunov function for E, if there exist a metric d, Koo functions a, a, a, and 
k G R + satisfying conditions (i) and: 

(iii) for any x, x' € R ra and for any u, v! G U, 

u) + f£/(z', u') < -KVfo z') + a{\\u - u'\\). 

To provide characterizations of J3-ISS (resp. 03-GAS) in terms of the existence of <5gTSS (resp. <5g-GAS) 
Lyapunov functions, we need the following technical results. 

Here, we introduce the following definition which was inspired by the notion of uniform global asymptotic 
stability (UGAS) with respect to sets, presented in |LSW96j . 

Definition 3.2. A control system E = (R n , U,W,/) is uniformly globally asymptotically stable (U^GAS) with 
respect to a set A C R™ if it is forward complete and there exist a metric d, and a ICC function j3 such that 
for any t G Rj, any x G R" and any v G 14 , the following condition is satisfied: 

(3.1) d(£ xv (t),A)<l3(d(x,A),t). 

We now introduce the following definition which was inspired by the notion of uniform global asymptotic 
stability (UGAS) Lyapunov functions in LSW96 . 

Definition 3.3. Consider a control system E = (R™, U, U, f ), a set A C R™, and a smooth function V : R" — > 
Rq . Function V is called a U^GAS Lyapunov function, with respect to A, for E, if there exist a metric d, 
/Coo functions a, a,, and K G R + such that: 

(i) for any x G R", 

a(d(x,A)) < V(x) < a(d(x,A)); 

(ii) for any x G R" and any u G U, 

Wf(x, U )<-KV{x). 

The following theorem characterizes U3GAS in terms of the existence of a U3GAS Lyapunov function. 

Theorem 3.4. Consider a control system E = (R n , U,Z//, /) and a set A C R n . If U is compact and d is a 
metric such that the function = d(-,y) is continuous 4 for any y G R™ then the following statements are 
equivalent: 

(1) E is forward complete and there exists a U^GAS Lyapunov function with respect to A, equipped with 
the metric d. 

(2) E is U^GAS with respect to A, equipped with the metric d. 

Proof. First we show that the function (/>(•) = d(-,A) is a continuous function with respect to the Euclidean 
metric. Assume {a^n}^i is a converging sequence in R" with respect to the Euclidean metric, implying that 
||a; n — x*\\ — > as n — > 00 for some x* G R™. By the triangle inequality, we have: 

(3.2) d(x*,y)<d( 
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for any n£N and any y £ A. Using inequality ( |3.2[ ), we obtain: 

(3.3) <j>(x*)=d(x*,A) = Md(x*,y)< inf " {d (x*,x n ) + d (y, x n )} 

yeA yeA 



d (x*,x„) + inf d(y,x n ) = d(x*,x n ) + 4>{x n ) . 
yeA 



for any n G N. Using inequality (3.3) and the continuity assumption on d, implying that lim n _ i . 00 d (x*, x n ) = 
d(x*,x*) = 0, we obtain for any n £ N: 

(3.4) <t>(x*)< inf {d(x*,x m ) + 0(x ro )}=^(x*)< lim va£<f>(x n ), 

m>n n— >oo 

where limit inferior exists because a lower bounded sequence of real numbers always admit a greatest lower 
bound RRA09]. By doing the same analysis, we have: 

(3.5) 4>{x*)> lim sup0(x„), 

n— y oo 

where limit superior exists because an upper bounded sequence of real numbers always admit a lowest upper 



bound |RRAQ9| . Using inequalities (3.4) and ( |3.5[ ), one obtains: 

4>[x*) = lim <f>(x n ) , 

n— >oo 

implying that <f> is a continuous function with respect to the Euclidean metric. Since <p{-) = d(-,„4) is a 

continuous, positive semi-definite function, by choosing uii(-) = cj 2 (-) = d(-,^4) in Theorem 1 in [TP00] . the 

proof completes. □ 

Before showing the main results, we need the following technical lemma, inspired by Lemma 2.3 in |Ang02| . 

Lemma 3.5. Consider a control system E = (R n , U,W, /). If S is S^-GAS, then the control system S = 

(R 2n ,U,UJ), where f((,v) = [f(£i,v) T ,f(&,v) T ] T , and ( = [£,f,&] T , is U^GAS with respect to the 
diagonal set A, defined by: 

(3.6) A = {z 6 R 2n \3x e K" : z = [x T ,x T ] T } . 



Proof. Since E is <5g-GAS, there exists a metric d 
we define a new metric d : K 2 ™ x K 2 ™ — > Mq by: 

(3.7) d(z, z ) = d(xi, x' 1 ) + d(x 2 , x 2 ), 

, T r „ mi T 



o" such that property (2.1) is satisfied. Now 



,T ,T 

x 1 , x 2 



p 2 ri 



for any z = [xi T , X2 T ] , z' 

of a metric. Now we show that d(z, A), for any z = [xj, x 2 ] 1 € R 2n , is proportional to d(xi, x 2 ) that will be 
exploited later in the proof. We have: 



It can be readily checked that d satisfies all three conditions 
T 



(3.8) dO,A)= inf d(z,z')= inf d 



( 


Xl 




' x' ' 


) 




x 2 




x' 





inf {d(xi,x') + d(x 2 ,x')} 



< inf {d(xi, x') + d(x 2 , x')} — d(xi, xi) + d(xi, x 2 ) — d{x\, x 2 ). 

x' —X\ 

Since d is a metric, by using the triangle inequality, we have: d(xi, x 2 ) < d(xi, x') +d(x2, x') for any x' € K n , 
implying that: 

(3.9) d(xi,x 2 )< inf {d(xi,x') + d(x 2 ,x')} = d(z,A). 



Hence, using (3.8 1 and (3.91, one obtains 
(3.10) 



Using equality (3.10) and property (2.1), we have: 



d(G„W,A) = d 



d(xi,x 2 ) < d(z, A) < d(xi,x 2 ) d(xi,x 2 ) = d(z,A). 



£xzv(t) 
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for any t £ Kq", any z = [xj, xj] 
respect to A. 



i 2n and any ueii, where ( zv = [£j lt; , £j 2 „] ■ Hence, £ is U3GAS with 

□ 



We can now provide characterization of $a-GAS in terms of existence of a (5a-GAS Lyapunov function. 

Theorem 3.6. Consider a control system £ = (M™, U,U, /). If \J is compact and d is a metric such that the 
function ip(-) = d(-,y) is continuous 4 for any y £ R™ then the following statements are equivalent: 

(1) £ is forward complete and there exists a 5^-GAS Lyapunov function, equipped with the metric d. 

(2) £ is 63-GAS, equipped with the metric d. 



Proof. The proof from (1) to (2) has been provided in Theorem 2.6 in [ZMllj . even in the absence of the 
compactness and continuit y ass umptions on U and d, respectively. We now prove that ( 2) im plies (1). Since 
£ is (5a-GAS, using Lemma 3.5 we conclude that the control system £, defined in Lemma 3J) is UgGAS with 



we conclude that the control system £, defined in Lemma 
respect to the diagonal set A. Since tp(-) = d(-, y) is continuous 4 for any y £ M. n , it can be easily verified that 
the function ijj(- ) = d(-, z') is also continuous for any z' £ M. 2n , where the metric d was defined in Lemma 



Using Theorem 3.4 we conclude that there exists a U3GAS Lyapunov function V : 



l>2/i 



3.5 



Iq , with respect 

to A, for £. Thanks to the special form of £, using the equality ( |3.10[ ), and slightly abusing notation, the 
function V satisfies: 



(i) o ( d 

(ii) 



x 
x' 



dV Wl 
dx dx' J 



f{x,u) 
f(x',u) 



< V 



< 



X 

x 1 



< a id 



x 
x' 



, Ajj => a(d(x,x')) < V(x,x') < a(d(x,x')); 
«v( I ^^f(x,u) + ^f(x',u)<-KV(x,x'), 



for any x, x' £ K ra , any u £ U, some /Coo functions a,a and some k £ M. + . Hence, V is a <5g-GAS Lyapunov 
function for £. This completes the proof. □ 



Before providing characterization of <5g-ISS in terms of existence of a <5gTSS Lyapunov function, we need the 
following technical lemma, inspired by Proposition 5.3 in [Ang02| . By following similar steps as in |Ang02| , 
we need to define the proximal point function saty : l m — > U, defined by: 



(3.11) 



satu(tt) = arg min \\u — u\ 



As explained in |Ang 02 , by assuming U is closed and convex and since || • || : W n — > Rq is a proper and convex 
function, the definition (3.11) is well-defined and the minimizcr of — u\\ with u' £ U is unique. Moreover, 
by convexity of U we have: 



(3.12) 



|satu(ui) - satu(u 2 )|| < - m 2 ||, Vui,u 2 £ 



Lemma 3.7. Consider a control system £ = (]R™, U, U, /), where U is closed and convex. If £ is 5^-ISS, 
equipped with a metric d such that ip(-) = d(-,y) is continuous 4 for any y £ R n , then there exists a /Coo 
function p such that the control system £ = (R 2 ™, D, T>, fj^ is U^GAS with respect to the diagonal set A, 
where: 

' /(£i,satu(wi+/j(d(£i,£2))w3)) 
/(£ 2 ,satu(wi - p(d(£i,£ 2 ))u; 2 )) 

C = [HT,£] T , D = U x S x (0 m ), and u = [^,^] T . 



Proof. The proof was inspired by the proof of Proposition 5.3 in |Ang02| . We include the complete details of 
the proof to ensure that the interested reader can assess the essential differences caused by using the arbitrary 

"D is the set of all measurable and locally essentially bounded functions of time from intervals of the form ]a, b[C R to D with 
a < and b > 0. 
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metric d rather than the Euclidean metric. Since £ is c^TSS, equipped with the metric d, there exist some 
ICC function (3 and /Coo function 7 such that: 

(3.13) <!(£,,„(*), &/„'(*)) <max{/?(d(a:,a/),t), 7(\\v - v'W^)}. 

Note that inequality ( 3.13[ ) is a straightf orw ard consequence of inequality ( 2.2[ ) in Dehnition 2.3 (see Remark 2.5 
in [SW95J). Using the results in Lemma 3.5 a nd t he proposed metric d in (3.7), we have that d(x, x') = d(z, A), 
where z = [x T , x' T ] T , and A was defined in ( 3.6 ). Without loss of generality we can assume a(r) = f3(r, 0) > r 
for any r E R + . Let p be a /Coo function satisfying p(r) < ij7 _1 o (a _1 (r)/4) (note that 7, a <E /Coo). Now we 
show that 



(3.14) 



7 (|2w2(t)p (d(C u (t) s A )) I) < d(«, A)/2, 



for any i £ Rq", any z E M 2 ", and any cj = [wf 6 2?. Since 7 is a /Coo function and G £>i(0 m ) for 

any i E Kg", it is enough to show 



(3.15) 
Since 



7 (2p(d(U(*),A))) <d(z,A)/2. 

<a- 1 (d(z,A)) /4<d(z,A)/4, 



7 (2p (d(U(0), A))) = 7 (2p (d>, A)) 

and <p(-) = d(-, A) is a continuous 4 function (see proof of Theorem 3.4), then for all t E M.q small enough, we 
have 7 (2p (d(( ZOJ (t), A))) <d(z,A)/4. Now, let 

*i =inf{t>0 I 7 (2 j0 (d(U(t),A))) >d(z,A)/2}. 

Clearly ii > 0. We will show that t\ = 00. Now, assume by contradiction that ti < 00. Therefore, the 
inequality (3.15) holds for all t € [0,£i). Hence, for all t E [0, ii), one obtains: 

(3.16) 7(|2w 3 (t)/»(d(U(t),A))|) < 7 (2p(d(U(*),A))) < d(z, A)/2 < a (d(z, A)) /2. 

Let i> and 1/ be defined as: 

w(t) - satu (ux(t) + p (d(Q u (t), A)) wa(<)) , 
t/(t) = satu (wi(i)-p(d(C zw (i),A)) w 2 (^ 



By using (3.12), we obtain: 

\\v(t)-v'(t)\\ < ||2«2(t)p(d(C w (t),A)) 
Using (3.13) and ( 3.16[ ), we have: 

(3.17) d(U(t), A) = d (H xv (t),L> v >(t)) < P (d(x, x'),0) = /3 (d(z, A), 0) = a (d(z, A)) , 

for any t E [0,ti), any u> E T>, and any z — [x T ,x lT ~\ T E M. 2n . Using p(r) < |7 _1 ° (a _1 (r)/4), the inequality 
(3.17) implies that 



(3.18) 



7 2p d(U(),A) <d( Z) A)/4, 



for any t E [0,t\). Since the function ip(-) = d( -,A) is continuous 4 , the inequality (3.18) contr adict s the 
definition of tx- Therefore, t% = 00 and inequality (3.14) is proved for all t E Rq . Therefore, using (3.13) and 
(3.14), we obtain: 

d(C*,(t),A) =d <max{ / 9(d(a;,ar0,t),7(lb-w , ||oo)} < 
max {/3 (d(<c, x'), i) , 7 (J^p (d(G w , A)) || ) } < max {/? (d(z, A), t) , d{z, A)/2} , 
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for any z = [x T , x' T ] € 1R 2 ™, any uj £ V, and any t G M.^J~ . Since /? is a ICC function, it can be readily seen 
that for each r > if d(z, A) < r, then there exists some T r > such that for any i > T r , /3 ^d(z, A), tj < r/2 

and, hence, d(( zul (t), A) < r/2. Now we show that the set A is a global attractor for the control system E. 
For any e £ R + , let k be a positive integer such that 2~ k r < e. Let r\ = r and r.; = i\-i/2 for z > 2, and 

let t = T ri +T r2 + VT rk . Then, for t > r, we have d(G w (i), A) < 2~ fe r < e for all d(z, A) < r, and all 

uj £T>. Therefore, it can be concluded that the set A is a uniform global attractor for the control system E. 
Furthermore, since d(C zul (t), A) < j3 {d{z, A), 0^ for all i € M^, all z € M 2n , and all weD, the control system 
E is uniformly globally stable and as shown in [TPOOj . it is U3GAS. □ 

Finally, the next theorem provide a characterization of J^-ISS in terms of the existence of a J^-ISS Lyapunov 
function. 

Theorem 3.8. Consider a control system E = (R", U,U,f). If U is compact and convex and d is a metric 
such that the function tp(-) — d(-, y) is continuous for any y £ M™ then the following statements are equivalent: 

(1) E is forward complete and there exists a S^-ISS Lyapunov function, equipped with metric d. 

(2) E is 63-ISS, equipped with metric d. 



Proof. The proof from (1) to (2) has been showen in Theorem 2.6 in |ZM11) . even in the absence of the 
compactness and convexity assumpti ons o n U and the continuity assumption on d. We now prove that (2) 
implies (1). As we proved in Lemma 3.7 since E is <5gTSS, it implies that the control system E, defined in 
Lemma 



3.7 



is U3GAS with respect to A. Since -(/>(•) = d(-,y) is continuous 4 for any y e R n , it can be easily 
verified that ?/;(•) = d(-,z') is continuous 4 for any z' £ K 2n , where the metric d was defined in the proof of 
Lemma [3. 5[ Using Theorem |3.4[ we conclude that there exists a U^ GAS Lyapun ov fun ction V, with respect 

the equality (3.10), and slightly abusing 



to A, for E. By using the special form of E, defined in Lemma 
notation the function V satisfies: 



3.7 



(i) o d 



x 
x' 



< V 



X 

x' 



< a id 



x 
x' 



a(d(x, x')) < V(x, x') < a(d(x, x'))\ 



for any x, x' £ M™, some /Coo functions a, a and 
(ii) 



(3.19) 



/(x,sat u (c?i + p(d(x,x'))d 2 )) 
f(x',sat v (di - p{d(x,x'))d 2 )) 



< -kV 



x 
x' 



&V dV_~ 
dx dx' 

dV dV 

/(x,satu(di + p(d(x,x'))d 2 )) + g^jf( x '^ sat u(^i - p{d(x,x))d 2 )) < -kV(x,x), 



dx ' 



for some k £ R + , any x,x' £ R", and any [d^,c?J] £ D. By choosing d\ = (u + u')/2 and d 2 = (u — 

u')/(2p(d(x, x'))) for any u, u' £ U, it can be readily checked that [dj, d 2 \ T £ U x B\(0 m ), whenever 2p(d(x, x')) > 
\\u — it'||. Hence, using (3.19), we have that the following implication holds: 



dV dV 

if ip{d(x,x')) > \\u-u ||, then —f{x,u) + —f(x',u') < -kV(x,x), 
where ip(r) = 2p{r). As shown in Remark 2.4 in [SW95J, there is no loss of generality in modifying inequalities 



(3.20) 

where 
([3~20l to 



<>V f^^ + ^fix^u^^-W^x^+aiWu-u'W), 



dx 



for some /Coo function a and some k £ M + , which completes the proof. 



□ 
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3.2. Contraction metrics description. In addition to incremental Lyapunov functions, the 5g-GAS and 
<5g-ISS conditions can be checked by resorting to contraction metrics. The interested reader may consult 
LS98J for more detailed information about the notion of contraction metrics. Note that for all definitions and 
results in this subsection we require function / to be continuously differentiable which was not the case in 
characterizations of incremental stability using incremental Lyapunov functions. 

Now we recall the notions of contraction metrics, presented in [LS98, ZT11 . 

Definition 3.9 ([LS98J. Let £ = (W 1 , U,U, f) be a smooth control system on K. n equipped with a Riemannian 
metric G. The metric G is said to be a contraction metric, with respect to states, for system £ if there exists 
some A £ R + such that: 

(3.21) (X,X) F <-\(X,X) G , 

for F(x,u) = (%) T G(x) + G(x)§£ + ^rf(x,u), any u £ U, X £ R n , and x £ R n . The constant A is called 
the contraction rate. 



Note that when the metric G is constant, the condition (3.211 is known as the Demidovich's condition 
[PvdWN051 IPPvdWN04l IDem67j . It is shown in |PvdWN05] that such condition implies S-GAS and the 
convergent system property for E. 

Definition 3.10 ([ZT11J. Le£E = (M ra ,U,W,/) be a smooth control system onW n equipped with a Riemannian 
metric G. The metric G is said to be a contraction metric, with respect to states and inputs, for system £ if 
there exist some A £ K + and a £ M.q such that: 

(3.22) (X,X) F + 2(^Y,XJ <-\{X,X) G + a{X,X)l{Y,Y)\ m , 

forF(x,u) = (f£) T G(z) + G(x)^ + |f f(x,u), any X 6l B , u£U, andY 6t m . The constant A 

is called the contraction rate. 



The following theorem shows that existence of a contraction metric, with respect to states and inputs, (resp. 
with respect to states) implies <5g-ISS (resp. Jg-GAS). 

Theorem 3.11. Let £ = (R™, U,lA,f) be a smooth control system on W 1 equipped with a Riemannian metric 
G and let U be a convex set. If the metric G is a contraction metric, with respect to states and inputs, (resp. 
with respect to states) for system S and (M n , dg) is a complete metric space, then E is 5^-ISS (resp. 6^-GAS). 



Proof. Since (M n ,dG) is a complete metric space, using the Hopf-Rinow theorem |Pet97| . we conclude that 
W 1 with respect to the metric G is geodesically complete. The rest of the proof is inspired by the proof of 
Theorem 2 in |AR03| . Consider two points x and x' in K™ and a geodesic \ '■ [0; 1] — ► R" joining x — x(0) and 
x' = x(l)- The geodesic distance between the points x and x' is given by: 

(3.23) d G (,, x<) = jf 1 J GMs^ds. 

Consider the straight line Xt( s ) — (1 — s ) v (t) + sv '(t), f° r fixed t £ Kq , fixed v, v' £ U, and for any s £ [0, 1]. 
The curve xt is a geodesic, with respect to the Euclidean metric, on the subset U C R m joining v(t) = Xt(0) 
and v'(t) — Xt(l)- Consider also the input curve v s defined by v s (t) = Xt{s). Let l(t) be the length of the 
curve {; x ( s )v s (t) parametrized by s and with respect to the metric G, i.e.: 

(3.24) l(t) = J j5? , G(Z xWv .(t))5Zd8, with 5£ = ^ x (s)v s (t). 
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In the rest of the proof, we drop the argument of the metric G for the sake of simplicity. By taking the 



derivative of (|3.24| with respect to time, we obtain: 
d 



dt 



lit) 



1 j yecst) 

o 



ds 



i ^ ( (M) T G + % / + G% ) « + 2*^ (g£) T ^ 



-ds, with (5-u = — v s (t). 

as 



Since G is a contraction metric, with respect to states and inputs, with A and a the constants introduced in 
Definition |3.10[ the following inequality holds: 



(3.25) 



V 8v T 5vds 



~J(*) + fll«(*)-«'(*)ll- 



Using (3.25) and the comparison principle Kha96j, wc obtain: 



l(t) <e-^l(0) 



r**||v(t) -«'(*) || 



Hv-t/Hoo <e-'*/(0) + ^\\v-v'\\ 



A v ' A 

where * denotes the convolution integra |5 From ( |3.23| ) and ( |3.24| , it can be seen that Z(0) = dc(x, x'). 
However, for i 6 M + , Z(i) is not necessarily the Riemannian distance function, determined by G, because 
£x(s)t> s M is n °t necessarily a geodesic, implying that it is always bigger than or equal to the Riemannian 
distance function^ (f ) , £ x 'v'(t)) < l(t), and, hence, the following inequality holds: 

d G (&«(*), &/«'(*)) < e"**d G (x,x') + "Wv-v'Woc, 

A 

which, in turn, implies that £ is Jg-ISS. The proof for the case that G is a contraction metric, with respect to 
states, can be readily verified by just enforcing 5v(t) = and v(t) = v'(t) for any t £ Rq . ^ 



Since completeness of the metric space (R n , dc) is crucial to the previous proof, the following lemma provides 
a sufficient condition on the metric G guaranteeing that (R",d<3) is a complete metric space. 

Lemma 3.12. The Riemannian manifold R n equipped with a Riemannian metric G, satisfying uj]\y\\ 2 < 



y T G{x)y for any x, y £ 
d G . 



and for some positive constant oj, is complete as a metric space, with respect to 



Proof. The proof was suggested to us by C. Manolescu. First, for each pair of points x, y £ M. n we define the 
path space: 

Q(x,y) = {x '■ [0, 1] — > R n | x is piecewise smooth, y(0) = x, and x(l) = J/}- 

Recall that a function x '■ [o-, b] — > R™ is piecewise smooth if x is continuous and if there exists a partitioning 
a = a± < a2 < ■ ■ ■ < at = b of [a, b) such that x|( ai ,a i+1 ) is smooth for i = 1, • • • , k — 1. We can then define the 
Riemannian distance function d.Q(x,y) between points x,y £ 1™ as 



d G (x,y) = inf / 



' dx(s) 
ds 



'\Ht)-v'(t)\\=ti< 



v(t) — v'(r)\\dT. 



Note that given a Riemannian metric G, the Riemannian distance function is the smallest distance, determined by G. 
^This condition is nothing more than uniform positive definitness of G. 
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It follows immediately that dg is a metric on R". The Riemannian manifold R™ is a complete metric space, 
equipped with the metric do, if every Cauchy sequenc^Jof points in R™ has a limit in R 71 . Assume {Xn\^ =1 
is a Cauchy sequence in R™, equipped with the metric dg. By using the assumption on G, we have 



xen(x n ,x m ) J Q y \ as J ds 




> s /uj inf / 4/I ^ ' \ ^ - ds — */us\\x„ — x r . 



It is readily seen from the inequality ( 3.26| ) that the sequence {^n}^Li * s a ^ so a Cauchy sequence in R" with 
respect to the Euclidean metric. Since the Riemannian manifold R™ with respect to the Euclidean metric is 
a complete metric space, the sequence {£ ra }^Li converges to a point, named x* , in R™. By picking a convex 
compact subset D C R", containing 2*, and using Lemma 8.18 in |Lee03j . we have: w||j/|| 2 > y T G(x)y for any 
y £ R™, x & D, and some positive constant uJ. Since the sequence {^nj^L! converges to x* e D, there exists 
some integer N such that the sequence {x n } c ^ =N remains forever inside D. Hence, we have: 

y/u\\x n - X*\\ < d G (x n ,X*) < Vw\\x n - 2*||, 

for any n > N. Therefore, the sequence {x n }^ = i converges to x* € R", equipped with the metric dp. 
Therefore, R™ with respect to the metric d G is a complete metric space. 

□ 



Resuming, in this section we have provided a characterization of <5g-GAS and c^TSS in terms of the existence 
of cJg-GAS and J^-ISS Lyapunov functions and we have provided sufficient conditions for 5g-GAS and <5g-ISS 
in terms of the existence of a contraction metric. Based on these results, in the next section, we propose a 
backstepping controller design procedure, providing controllers rendering control systems incrementally stable. 
Additionally, we will provide incremental Lyapunov functions and contraction metrics (the latter for smooth 
control systems). 



4. Backstepping Design Procedure 



The backsteping method proposed here is inspired by the backstepping method, described in PvdWNOS . 
Here, we will extend this approach to render the closed-loop system Jg-ISS and to construct JgTSS Lyapunov 
functions. Consider the following subclass of control systems: 

v = f(ViO, 



(4.1) 



where x — [y T , z T ] € R™i + ™<; is the state of E, y and z are initial conditions for 77, ^-subsystems, respectively, 
and v is the control input. 



In support of the main result of this section (Theorem 4.2), we need the following technical result. 
Lemma 4.1. Consider the following interconnected control system 

v = f(v,C>v), 



<"> -u -««,.). 

Let the n-subsystem be S^-ISS with respect to v and let the (^-subsystem be S^-ISS with respect to v for some 
metrics d^ and d^, respectively such that the solutions ^cF"! an< ^ Cz« sa ^ s fy ^ e following inequalities: 

(4.3) d 71 ( VyCv (t) 

7 Vy'C'v' CO) < Pr, (d v (y, y') , t) + 7 C (d c (C, C') 

(4.4) d c < k (d C (z, *') ,t)+% (\W ~ v'\\J , 



sequence {x n ]'^'_- l in a metric space X, equipped with a metric d, is a Cauchy sequence if lim^m—joo d(x n , x m ) = 0. 
^Notation 1J V ^ V denotes a trajectory of ^-subsystem under the inputs f and v from initial condition y £ R n? J. 
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where y, y' and z, z' are the initial conditions for the n, (^-subsystems, respectively. Then, the interconnected 



control system E in (4-2) is S^-ISS with respect to v. 



Proof. The proof was inspired by the proof of Proposition 4.7 in |Ang02| . The essential differences lie in the 
choice of the metric for the overall system S using the metrics for rj, (-subsystems. We provide the proof so 



that it can be easily compared with the proof in |Ang 02 . Using (4.3 1, (4.4) and triangular inequality, the 
following chain of inequalities hold: 



oo) 



dviVvfrifyVv'Cv'it)) < P v (d„ (% c „(V2),7?j,'c«'(V 2 ))>*/ 2 )+7c ( d C (C, C')[t/2,oo)) + 7* (\\v - v'|| [t/2 , 

< p„ (p n (d n (y, y'),t/2) + 7C (d c (C, COoo) + 7. (\\v - v'\U , t/2) 

+ 7C ( d C (C,C')[t/2,oo)) +7. (ll w -w'll[t/ 2 ,oo)) 

< p n (3A,(d,(», y'), t/2), t/2) + p v (3 7c (d c (C, C') J >*/2) + Pn (37. (II" - «/|U) , 0) 

+ 7C ( d C (C>C')[t/2,oo)) +7. - v '\\[t/2,oc)) 

< P n (3^(d n (t/, y'), t/2), t/2) + /3„ (3 7c (P C (d c (z, z') , 0) + % (\\v - v'\\J) , t/2) 

+ p n (3 7 „ (\\v - t/||oo) , 0) + 7C (d C (C, C') [t /2,oo)) + 7. (||« - v'\\ W 2,oo)) 

< P v (W n (d n (y, y'), t/2),t/2) + /3„ (3 7c (2f3 Q (d c (z, z') , 0)) , t/2) 
+ p n (3 7c (2 7l) (\\v - v'WJ) , t/2) + p,, (3 7 „ (||« - t/|U) ,0) 

+ 7C ( d C (C,C')[t/2,oo)) +7« (||U- w 'll[ f /2,oo)) 

< A, (3A,(d,(w, V'), t/2), t/2) + p n (3 7c (2f3 c (d c (z, z') , 0)) , t/2) 
+ p v (3 7c (2 7 „ (|| v - v'lU) , 0) + p n (3 7 „ (||« - u'lU) , 0) 

+ 7C ik ( d C (*, , t/2) + 7u (||u - t/||oo)) + 7u (||t; - t/|| [i/2i0o) ) 

< A (3fl,(d,(y, 2/')- */2). */2) + Pv (^C ( 2 A ( d C (*, > 0)) , t/2) 
+ A, (3 7c (2 7l) (||t; - t/||J) , 0) + p n (37 U (||« - t/||oo) , 0) 

+ 7C (2/3 c (d c (z, z') , t/2)) + 7C (2% (1^ - t;'^)) + 7t) (||„ - t/|U 

(4-5) < £(d„(y, y'), t) + (d c (z, z'),t) + 7 (||t; - v'lU , 



where 7 € /Coo and P,P £ ICC are defined as following: 



7(r) = A (3 7c (27„(r)) , 0) + /?„ (3 7 „(r),0) + 7c (2 7 „(r)) + 7u (r), 
p(r,t)=p v (3p n (r, t/2), t/2), 
£(r,t) = /?, (3 7c (2/3 c (r,0)),t/2) + 7c (2/3 c (r, t/2)) . 



Now we define a new metric d : M n "+ n c x M">j+™<: 



by: 



d(x, x') = d v (y, y') + d c (z, z'), 



for any x = [y T , z T ] £ M. n v+ n c anc j x ' 
three conditions of a metric. By defining £ 



G R™»7+ n c. it can be readily checked that d satisfies all 



77 T C T 



, using inequalities (4.4) and (4.5), and for any 
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t G Kq , any x, x' € M n " +n c , and any v, v' £ U, we obtain: 

(t))+d c (C«,(t),C*'t»'(*)) 

< P(d v (y, y'),t) + p(d c (z, z'),t) + 7 - v'W^) 
+/3 c (d c (z,z'),t)+%(\\v-v'\\J 

< P(d v {y, y') + d c (z, z'),t) + (3 {d v {y, y') + d c (z, z'),t) 

+/3 C (d v (y, y') + d c (z, z f ) ,t) + 7 (||i; - t/||oo) + 7« (||« - A 00) 

< /3(d(x,x'),t)+ 7 (|| U -i;'|| co ), 
where /? € /C£ and 7 € /Coo are defined as following: 

(3(r,t) = + 
7 (r) = 7(r)+7„(r). 
Hence, the overall system £ of the form (14.21) is 5g-ISS with respect to v. 



□ 



We can now state the main result, on a backstepping controller design approach for the control system £ in 
(4.1), rendering the resulting closed-loop system (Jg-ISS. 



Theorem 4.2. Consider the control system £ of the form (4-D- Suppose there exists a continuously differ- 
entiable function if) : K™'> — > IR"<-' such that the control system 

(4.6) Y, v :r ] = fM{r t )+v) 

is S^-ISS with respect to the input v. Then for any X € R + , the state feedback control law: 



(4.7) v = k(r],C,v) 

renders the control system £ 5^-ISS with respect to the input v 



dtp 



dy 



Proof. Consider the following coordinate transformation: 



(4.8) 



Xi 

\2 



where £ = \rj T , £ T ] . In the new coordinate Xi wc obtain the following dynamics: 

/ a q\ ^ / xi = f(xi,i>ixi) +X2), 

{ 9j I Xa = «-g(xi)/(xi,to) + Xa). 

The proposed control law (4.7), given in the new coordinate \ by 

(4.10) 



dtp, 



v = Kxi,X2 +^(xi),u) = -AX2 + -^-(xi)/(xiXxi) +X2) +v, 



transforms the control system £ into: 
(4.11) £ 



Xi = f{Xi,^[Xi) + X2), 
X2 = -AX2 + 



Due to the choice of ip, the xi-subsystem of £ is (5g-ISS with respect to \2- It can be easily verified that 
the X2-subsystem is input-to-state stable with respect to the input v. Since any ISS linear cont rol system is 
also (5-ISS |Ang02| , X2-subsystem is also (5-ISSj^jwith respect to v. Therefore, using Lemma 4.1 we conclude 
that the control system £ is 5g-ISS with respect to the input v. Since, JgTSS property is coordinate invariant 
[ZTllj . we conclude that the original control system £ in (4.1 ) equipped with the state feedback control law 
in (4.7) is (5g-ISS with respect to the input v which completes the proof. □ 
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We recall that 5-ISS property is equivalentt to (S3-ISS property with respect to the Euclidean metric. 
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Remark 4.3. The - IS S property of system in [4-6) can be stablished, for example, using the approaches 
provided in PvdWN05, vdWP08 for some relevant classes of control systems (such as piece-wise affine systems 
and Lur'e-type systems). 



Remark 4.4. The result of Theorem \4-%\ can be extended to the case that we have arbitrary number of 
integrators: 

V = f(v,Ci), 
Ci = Ca, 



Cfe = v. 

Note that in this case, the functions f and tp must be sufficiently differentiable. 

Although the proposed approach in Theorem |4.2| provides a controller rendering the control system S of the 



form (4.1 1 <5g-ISS, it does not provide a way of constructing <5g-ISS Lyapunov functions or contraction metrics. 



In the next lemmas, we show how to construct incremental Lyapunov functions and contraction metrics for 
the resulting closed-loop system, recursively. Note that the constructed increm ental Lyapunov functions can 
be used as a necessary tool in the analysis in |GPT09| IGirl2l |JFA + 07| lKDL+08] . We will show in the example 
section how explicit availability of an incremental Lyapunov function helps us to use the results in |GPT09j to 
construct a finite bisimilar abstraction for an incrementally input-to-state stable (non-smooth) control system. 



Lemma 4.5. Consider the control system S of the form (4-1). Suppose there exists a continuously differ- 
entiable function tp : M. n *> — > E" c such that the smooth function V : K n " x R n " — > 
function for the control system 



5j-ISS Lyapunov 



(4.12) 



3.1 



for some 



and with respect to the control input v. Assume that V satisfies condition (Hi) in Definition 
K € R + and some a £ /Coo, satisfying o~(r) < Tir 2 for some k 6 R + and any r £ Kg". Then the function 
V ; R"i+' 1 c x R»';+"c _> R+, defined as 

V(x, x 1 ) = V(y, y 1 ) + \\{z- i>(y)) - (z' - ^{y'))\\ 2 , 

T 



where x = \y T , z T 



and x' 



[y' T ,z' T ] 



, is a 5^-ISS Lyapunov function for £ as in (4-1) equipped with the 
state feedback control law (4.1) for all A > K+ 2 ■ 



Proof. As explained in the proof of Theorem 4.2 using the proposed state feedback control law (4.7 1 and the 



coordinate tr ansfo rmation <p in (4.8|, the control system S of the form (4.1 1 is transformed to the control 



system S in (4.11 ). Now we show that 

V(x,x') = + (x 2 - x' 2 ) T (x 2 - x' 2 ), 

is a ^3-ISS Lyapunov function for S, where x = [xj ,x 2 ~\ T and x' = \x'\ , x' 2 T ] T are the states of S and 
xi,x[, and x 2 , x' 2 are the states of Xij X2 _ subsystems, respectively. Since V is a J^-ISS Lyapunov function for 
Xi-subsystem when \i is the input, it satisfies condition (i) in Definition |3 . 1 1 using a metric d as follows: 

a(d{x 1 ,x' 1 )) < Vixi,^) < a(d(xi,x[)), 

for some a, a £ K.^. Now we define a new metric d : R n "+ n c x R n i+ n c — > K+ by 

(4.13) d(x,x') = d(£i,2i) + \\x 2 - 

It can be readily checked that d satisfies all three conditions of a metric. Using metric d, function V satisfies 



condition (i) in Definition 3.1 as follows: 

fi (d(x, x 1 ) ) < V(x, x')<-p{ d(x, x 1 ) 
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where £ /Coo, M fd(x, = ffi(d(xi,$i)) + \\x 2 — 3?^ 1 1 2 , and /i fd(x,S')^ = a(d(xi,x' 1 )) + \\x 2 — x' 2 \\ 2 . 

Now we show that V satisfies condition (iii) in Definition 3.1 for E. Since V is a <5g-ISS Lyapunov function 
for xi-subsystem when \i is the input, A > , <r(r) < /?r 2 , and using the Cauchy Schwarz inequality, we 

have: 



dV 

dx 



dV 



[f@l,TP(X!) + x 2 ) T , -Xx T 2 +u T ] + ^ [f(x , 1 ,^P(x' 1 ) + x' 2 ) T , -Xx' 2 T + u' T ] < 



dV 
dx\ 



dV 



f{x x ,il){x x ) + x 2 ) + ■K^-f{x' 1 ,i>(x' 1 ) + x' 2 ) + 2(x 2 - x' 2 f {-Xx 2 +u)- 2(x 2 - x' 2 f (-Xx' 2 + u') < 



dx' x 



-kV{x u ^i) +<r(\\x 2 -x' 2 \\) - 2X\\x 2 - x' 2 \\ 2 + 2(x 2 - x' 2 y (u-u') < 



k\\x 2 - x' 2 \ i2 



—kV(xi,x 1 
-kV{xi,s^i) + k\\x 2 - x' 2 \\ 2 



|| 2 - 2A||$ 2 ~ s^ll + 2 P2 - x 2 \\\\u-u'\\ < 



2X\\x 2 



^ II 2 



+ \\' £ 2-X 2 \\ 2 + \\U 

-nV(x,x') + ||u-m'|| 2 



u'W 2 < 



The latter inequality implies that V is a <5a-ISS Lyapunov function for E. Since <5g-ISS Lyapunov functions 



are coordinate- invariant |ZMllj . we conclude that the function V 



■on v +n 



„-t-"c x 



H) ■ 



defined by 



V(x, x') = V{ct>{x)^{x')) = V(y, y') + \\{z- ^(y)) - (z> - ^y'))\\ 2 , 



is a #g-ISS Lyapunov function for E, as in (4.1 1 equipped with the state feedback control law in (4.7). 



□ 



Remark 4.6. One can use the LMI based results in |PvdWN05l IPvdWN07l lvdWP08| to find a quadratic 
8^-ISS Lyapunov junction for system E^ in {4-12). 

Remark 4.7. It can be verified that the backstepping design approach for strict-feedback form control systems, 
proposed in |ZMllj . is a special case of the results in Lemma 4-5 The results in [ZM11] can be easily obtained 
by recursively applying the results proposed in Lemma \4-5\ Moreover, one can construct a metric d for a 



strict-feedback form control system, satisfying (2.3), by recursively applying the construction in (4-13) and 
applying the change of coordinate in (4-8). 



The next lemma shows how to construct contraction metrics for the closed-loop system resulting from the 



backstepping controller synthesis technique in Theorem 4.2 



Lemma 4.8. Consider the control system E of the form (4-1) and assume function f is smooth. Suppose 
there exists a continuously differentiate function tp : R. n i — > M™« such that the metric G : 
contraction metric, with respect to states and inputs, for the control system 

Z n ■ rj = fiv^iv) +v), 
?+ 



satisfying the condition (3.22) for some X £ 

G(x) = 



and a S Kq 
t 



The 



S(v) + (g) g "(f) 



where x = \y T , £ T ] , is a contraction metric, with respect to states and inputs, for E as in (4-.1) equipped with 
the state feedback control law in (4- r l) for all X > Q*. 

8 A 



Proof. As explained in t he proof of Theorem 4.2 using the prop osed control law (4.7) and the coordinate 
transformation tj> in (4.8), the control system E of the form (4.1) is transformed to the control system E in 
(4.11 ). Now we show that the metric 



G(x) 



G{xi) nvXn( . 
On/- xn„ *?v 
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is a contraction metric, with respect to states and inputs, for S, where x = \xj , x 2 ] T is the state of E, and X\, 
and x 2 are states of xii X2-subsystems, respectively. It can be easily seen that G is positive definite be cause 
G is positive definite since it is a contraction metric for S^. Now we show that G satisfies the condition (3.22) 
for the control system S. Since G is a contraction metric, with respect to states and inputs, for xi-subsystem 
when \2 is the input, we have: 



X{ 



)*1 



(4.14) 



< 



-XXfGix^X! + a (xf G(^)Xi) 2 (x 2 T X 2 



for any Xi,£i G K™", X 2 ,x 2 € M" c , some A € R + , and some a € Kq . By choosing A > g~, using (4.14), and 
the Cauchy Schwarz inequality we obtain: 



Xj Xj 



d [/, -Xx 2 + m] 
9x 



G(s) + G(z) 



dG 

dx 



f(xi,tp(xi) + x 2 ) 

— \x 2 + U 



Xi 
X 2 



2Y 1 







1 T 



xj xf 



(^) T G(Si) + G(x 1 )^ 
(£) T G(xi) 



-2AI. 



n v xri( 



9/ 



G(z) 



Xi 

x\ 



X 2 



2F T X 2 < 



2F T X 2 < 



A < X l5 X x \ - AX 2 T X 2 + 2VF T r,/x 2 r X 2 + ( X u X x \ < 



for any X 



Xf Xj 



-\(x,x) G + 2(x,xY G (Y,Y)l t , 

, any a; = [xf ir^] 7, G R"i + " c , any Y e M" c , and some A G M. + . Hence, 

G is a contraction metric, with respect to states and inputs, for S. Since a contraction metric, with respect 
to states and inputs, is coordinate invariant [ZTllj . we conclude that G — 4>*G is a contraction metric, with 
respect to states and inputs, for E as in (4.1) equipped with the state feedback control law in (4.7). This 
completes the proof. □ 



Remark 4.9. It can be verified that the back-stepping design approach for strict-feedback form control systems, 
proposed in jZTllj . is a special case of the results in Lemma 4-8 The results in |ZTllj can be easily obtained 
by recursively applying the results proposed in LemmaW^ 



5. Example 

We refer the interested readers to the provided example in |ZvdW12"] . illustrating the results in this paper 
on a four-dimensional non-smooth control system. Here, we study another non-smooth control system and 
use the results in this paper to explicitly construct a <5g-ISS Lyapunov function, which, in turn, is employed 
to construct a finite equivalent abstraction using the results in [GPT09 . Consider the following non-smooth 
control system: 



(5.1) 



rji = sat(?7i) + 771 + 5Ci 

Ci = C1 2 + v! + v, 
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where sat : R — ► R is the saturation function, defined by: 

f -1 if x < -1, 
sat(x) = < x if \x\ < 1, 
[ 1 if a; > 1. 

It can be readily verified that E is unstable at (0, 0), implying that E is not (5g-ISS. The results in |JL02[ ISK09I 
SK08, [Z"T1HIZMTT] can not be applied to design controllers that render the system E <5g-ISS because the right 
hand side of E in (5.1| is not continuously differentiable. The results in [PvdWN05 also can not be applied 
because these results would result in a closed-loop system which is input-to-state convergent rather than <5g- 
ISS. Note that here we require 5g-ISS and a (5gTSS Lyapunov function in order to construct a finite equivalent 
abstraction using the results in GPT09 . By introducing the feedback transformation v — (f + r]\ + v, the 
control system E is transformed into the following form: 

771 = sat(77i) + 771 + 5Ci, 
Ci = v. 

Now by choosing ipivi) = ~Vi an d substituting ip{t]x) + v instead of Ci, we obtain the following ?/-subsystem: 

T, v : { rji = sat(?7i) + 771 + 5(i>(r}i) +v) = sat(?7i) - 4771 + 5v. 

It remains to show that E,, is (5g-ISS with respect to v. By choosing the function Vi(j/i, y[) = (j/i — y[) 2 , where 
yi and y[ are states of E,,, and using the Cauchy Schwarz inequality, we have that: 

|^ (sat(yi) - %! + 55) + |^ (sat (yi) - Ay[ + 55') < 

-8(1/1 - y'if + 2|lft - l/i||sat(i/i) - sat(yi)| + lOfoi - y'^u - 5') < 
-8(2/1 - y[) 2 + 2{ Vl - y[f + 10( yi - y'i){u - u') < 
-5(y 1 -y'- L ) 2 + 25(u-u') 2 , 

showing that V\ is a (5g-ISS Lyapunov function for E^ and, hence, E^ is i5g-ISS with respect to v. By using 
the results in Theorem 



4.2 for the control system E, we conclude that the state feedback control law: 
= - A (Ci + r)i) - (satfa) + + 5Ci) 



A(Ci - i>{vi)) + Vi + v 



makes the control system E <5g-ISS with respect to input v, for any A G 
control law 



Therefore, the state feedback 



c 2 

SI ' 



Using Lemma 



4.5 



(5.2) v = k(T)x,&,v) = fe(77i,Ci,u) 

makes the control system E 5g-ISS with respect to input v. 

we conclude that the function V : R 2 x R 2 — > Rq , defined by 

v(x,x') = ViCwi.j/i) + I (zi - 1&G/1)) - (4 - V(y'i)) I 2 

= ( 2 / 1 - 2 /i) 2 + ((z 1 + yi )-K+ 2/ i)) 2 

2 1 



(.x-a;') T P(a;-x') = (as - a/f 



1 1 



(x — x') 



where x — [y\,z{\ is the state of S, is a <5g-ISS Lyapunov function for the control system E equipped with 
the state feedback control law k in (5.2) with A > +„ + 1 . Here, we choose A = 16. 



It can be readily verified that the function V(x, x') — y/V(x, x') is also a <5gTSS Lyapunov function for the 
control system E equipped with the state feedback control law k in (5.2) with A > 25 +„ + 1 , satisfying: 
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(i) for any x,x' £ M. 2 , 

V X mL(P) \\x-x'\\ < V(x,x') < y/X m ^(P)\\x-x'\\; 

(ii) for any a:, x' £ M 2 and for any u,u' £ U CI, 

§f(x,k(x,u)) + &f(x',k(x',u')) <- 2 .5V{x,x') + '£$j i 

(iii) for any x,y, z £ 



p2 



V(x,y)-V(x,z) 



^ A max (P) ii I 

< K ' -\\y — z\ 



where A m ; n (P), and A ma x(-P) stand for minimum and maximum eigenvalues of P. Note that the property (iii) 
is a consequence of Proposition 10.5 in [Tab09 . 

Finite abstractions are simpler descriptions of control systems, typically with finitely many states, in which 
each state of the abstraction represents a collection or aggregate of states in the control system. Similar finite 
abstractions are used in software and hardware modeling, which enables the composition of such abstrac- 
tions with the finite abstraction of the control system. The result of this composition are finite abstractions 
capturing the behavior of the control system interacting with the digital computational devices. Once such 
abstractions are available, the methodologies and tools developed in computer science for verification and 
controller synthesis purposes can be easily employed to control systems, via these abstractions. However, for 
constructing a bisimilar finite abstraction, using the results in |( il' 1091 which does not impose any restriction 
on the sampling time, the control system is required to be incrementally stable and to exhibit an incremental 
Lyapunov function. The incremental stability property bounds the error propagations coming from discretiza- 
tion of the state space and input set in the process of constructing the finite bisimilar abstractions. We refer 
the interested readers to |Tab09j for more detailed information about the finite abstractions and their great 
advantages in controller synthesis problems. 

No w, w e construct a finite abstraction 5(E) for the control system E, equipped with the control input v 



in (5.2), using the results in |GPT09j . We assume that v(t) £ U = [-10, 10], for any t £ KJ, and v 



belongs to set U that contains piecewise constant curves of duration t = 0.1 second (r is the sampling 
time) taking values in [D] = {u £ U | u = 0.5k, fcgZ}. We work on the subset D = [—1, 1] x [—1, 1] 

of the state space E. For a given precision^] e = 0.1 and using properties (i), (ii), and (iii) of V, we 
conclude that D should be quantized with resolution of r\ = 0.009, using the results of Theorem 4.1 in 
|GPT09j . The state set of 5(E) is [D],, = {x £ D | Xi = hr), ki£Z, i= 1,2}. It can be readily seen that 
the set [D]^ is finite. The computation of the finite abstraction 5(E) was performed using the tool Pessoa 



|Pes09j . Using the computed finite abstraction, we can synthesize controllers, providing v in (5.2 1, satisfying 



specifications difficult to enforce with conventional controller design methods. Here, our objective is to design 



a controller navigating the trajectories of E, equipped with the control input v in ( 5.2 1, to reach the target set 
W = [-0.05, 0.05] x [-0.05, 0.05], indicated with a red box in Figure[2j while avoiding the obstacles, indicated 
as blue boxes in Figure [2] and remain indefinitely inside W . Furthermore, we assume that the controller is 
implemented on a microprocessor, which is executing other tasks in addition to the control task. We consider 
a schedule with epochs of three time slots in which the first slot is allocated to the control task and the other 
two to other tasks. A time slot refers to a time interval of the form [kr, (k + l)r[ with k £ N and where r is 
the sampling time. Therefore, the microprocessor schedules is given by (depending on the initial slot): 

|auu|auu|auu|auu|auu|auu|auu - - - , 

|uua|uua|uua|uua|uua|uua|uua| - - - , 

|uau|uau|uau|uau|uau|uau|uau - - - , 

where a denotes a slot available for the control task and u denotes a slot allotted to other tasks. We assume that 
in unallocated time slots, the input v is identically zero. The schedulability constraint on the microprocessor 
can be represented by the finite system in Figure [T] 

12 The parameter e is the maximum error between a trajectory of the control system and its corresponding trajectory from 
the finite abstraction at times kr, h £ No, with respect to the Euclidean metric. 
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Figure 1. Finite system describing the schedulability constraints. The lower part of the 
states are labeled with the outputs a and u denoting availability and unavailability of the 
microprocessor, respectively. 
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Figure 2. Evolutions of the closed-loop system with initial conditions (0.8, 0.9), and (—0.8, —0.9). 



A controller, providing v in ( |5.2[ ) and enforcing the specification has been designed by using standard algorithms 
from game theory, implemented in Pessoa, where the finite system is initialized from state q2, see second 
sequence above. In Figure [2j we show the closed-loop trajectories of E, equipped with the control input v 
in (5.2 1 (including the additional controller for v) and stemming from the initial conditions [0.8, 0.9] and 
[—0.8, —0.9]. It is readily seen that the specifications are satisfied. In Figure [3j we show the evolution of the 



input signal v in (5.2 1 corresponding to the two initial conditions. It can be easily seen that the schedulability 



constraint is also satisfied, implying that the control input v is identically zero at unallocated time slots. 

Resuming, the explicit availability of an incremental Lyapunov function let us to use the results in [GPT09 
to construct a finite abstraction 5(E) for the control system E in (5.1), equipped with the control input in 
(5.2). This finite abstraction allowed us to use tools developed in computer since to synthesize a controller 



satisfying some logic specifications difficult to enforce using conventional controller synthesis methods. 



6. Discussion 



In this paper we provided the characterizations of incremental stability, defined in |ZTllj , in terms of existence 
of incremental Lyapunov functions, defined in [ZMllj . We also provided sufficient conditions for incremental 
stability in terms of contraction metrics. Moreover, we developed a backstepping procedure to design con- 
trollers enforcing incremental input-to-state stability (or contraction properties) for the resulting closed-loop 
system. The proposed approach in this paper generalizes the work in |JL021 ISK091 ISK081 IZTlf 1 IZMI 1| by 
being applicable to larger classes of (not necessarily smooth) control systems and the work in [PvdWNOB"] by 
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Figure 3. Evolutions of the input signals v\ and i>2, corresponding to initial conditions 
(0.8, 0.9), and (-0.8, -0.9), respectively. 

enforcing incremental input-to-state stability rather than input-to-state convergence. Moreover, in contrast to 
the proposed backstepping design approach in jPvdWN05j , here we provided a way of constructing incremental 
Lyapunov functions, which are known to be a key tool in the analysis provided in GPT09 Girl2. JFA+07 
IKDL+08] , As we showed in the example, the explicit existence of an incremental Lyapunov function helps us 
to use the results in |GPT09] to construct a finite bisimilar abstraction for a resulting incrementally stable 
closed-loop (non-smooth) control system. 
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